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1^  Abstract  (MAXimum  aoo  wordt) 

The  use  of  test  standards,  or  phantoms,  to  evaluate  the  performance  of  a  computed  tomography  (CT) 
system  is  critical  to  monitoring  the  system  performance  and  ensuring  lire  sensitivity  to  features  of  imercst. 
Test  phantoms  for  monitoring  performance  have  been  used  in  the  Advanced  Development  of  X-Ray 
Computed  Tomography  Applications  program  to  establish  quantitative  measures  for  the  inherent  image 
quality  and  measurement  capability  of  the  CT  systems  used.  The  phantoms  allow  the  detennination  of 
resolution  and  contrast  sensitivity  of  the  CT  system  for  each  set  of  scan  parameters.  In  addition  to  image 
quality  phantoms,  inaterial/density  calibration  phantoms  and  positional  registration  phantoms  are 
discuss^. 

This  task  assignment  on  standards  has  determined  that  simple  phantoms  can  be  effectively  used  for 
relative  measurements  of  inherent  image  quality.  Tlie  use  of  tlie  modulation  transfer  function  (MTF)  and 
contrast  discrimi.nation  curves  calculated  from  scans  of  image  quality  phantoms  can  be  used  to 
successfully  characterize  system  performance.  When  CT  evaluations  are  to  be  perfonned  on  a  specific 
component  type,  a  phantom  that  enables  measurement  of  the  specific  characteristics  desired  in  the 
inspection  should  be  used. 
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SUMMARY 


The  use  of  test  standards,  or  phantoms,  to  evaluate  the  performance  of  a  computed  tomography 
(CT)  system  is  critical  to  monitoring  the  system  perfonnance  and  ensuring  tlie  sensitivity  to 
features  of  interest.  Test  phantoms  for  monitoring  performance  have  been  us^  in  the  Advanced 
Development  of  X-Ray  Computed  Tomography  Applications  program  to  establish  quantitative 
measures  for  the  inherent  image  quality  and  measurement  capability  of  the  CT  systems  used.  The 
phantoms  allow  the  determination  of  resolution  and  contrast  sensitivity  of  the  CT  system  for  each 
set  of  scan  parameters.  In  addition  to  image  quality  phantoms,  material/density  calibration 
phantoms  and  positional  registration  phantoms  are  discuss^ 

This  task  assignment  on  standards  has  detennined  that  simple  phantoms  can  be  effectively  used  for 
relative  measurements  of  inherent  image  quality.  The  use  of  the  modulation  transfer  function 
(MTF)  and  contrast  discrimination  curves  calculated  fiom  scans  of  image  quality  phantoms  can  be 
used  to  successfully  characterize  system  perfonnance.  A  dimensional  measurement  phantom 
metric  provides  a  useful  quantitative  measure  of  inherent  geometric  accuracy  of  a  CT  scaimer. 
When  CT  evaluations  are  to  be  performed  on  a  specific  component  type,  a  phantom  that  enables 
measurement  of  the  speciric  chai^:teiistics  desired  in  the  insp^tion  should  be  used. 
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1.0 


INTRODUCTION 


The  Advanced  Development  of  X-Ray  Computed  Tomography  Applications  demonstration 
(CTAD)  program  evaluated  the  aircraft/aerospace  components  applications  for  which  computed 
tomography  (CT)  could  be  cost-effectively  employed.  The  program  was  "task  assigned"  so  that 
specific  CT  applications  or  application  areas  could  be  address^  in  separate  projects.  The  results  of 
each  task  assigned  project  were  distributed  to  government  and  industry  through  interim  reports. 
References  1  toough  17  are  task  assignment  reports  issued.  In  order  to  test  CT  for  any  application 
and  be  able  to  evaluate  the  potential  of  CT  to  reveal  features  of  interest,  it  is  necessary  to  have  some 
quantitative  measures  of  the  image  quality/data  accuracy  of  the  CT  systems  employed.  This  interim 
report  is  the  result  of  a  tosk  assignment  which  considers  the  use  of  various  CT  standards  or  test 
phantoms  in  the  evaluation  of  CT  image  quality. 

1 . 1  X-ray  Computed  Tomography 

X-ray  CT  is  a  powerful  nondestructive  evaluation  technique  that  was  conceived  in  the  early  1960s 
for  medical  diagnosis  and  has  found  increasing  application  to  industrial  products.  Computed 
tomography  collects  X-ray  transmission  measurements  from  many  angles  about  a  component  to 
digit^ly  reconstruct  a  map  of  the  relative  linear  attenuation  coefficient  of  small  interior  volume 
elements  and  view  them  as  cross  sectional  images.  The  clear  images  of  interior  planes  are  achieved 
without  the  confusion  of  superimposed  features  often  found  wiA  conventional  film  radiography. 
In  addition  to  qualitative  feature  detection,  CT  can  provide  quantitative  information  about  the 
materiaJ/density  and  dimensions  of  features  imaged.  The  application  of  CT  for  industrial 
measurements  has  resulted  in  the  development  of  a  wide  range  of  CT  systems  suited  to  the 
inspection  of  a  variety  of  industrial  components. 

1 .2  Objectives  and  Scope 

This  task  assignment,  designated  "Task  7  -  Standards,"  was  directed  at  the  evaluation  of  test 
phantoms  for  monitoring  image  quality  in  CT  systems  used  for  industrial  applications.  Ph^toms 
are  similar  test  samples  primarily  used  to  evaluate  or  verify  the  quality  or  measurement  capability  of 
a  test  system.  Standards  are  precisely  defined  Goveniment  and/or  industry  certified  test  samples 
used  to  maintain  equivalence  between  measurements  taken  in  different  labs  or  using  different 
equipment  This  report  discusses  the  background  considerations  used  in  selecting  test  phantoms, 
the  results  of  testing  on  a  variety  of  CT  systems,  and  the  conclusions  drawn.  The  objective  was  to 
evaluate  several  types  of  test  phaiuoms  and  suggest  a  practical  approach  to  the  generation  of 
standards  in  aircrafi  component  CT  examinations. 

A  variety  of  CT  systems,  both  medical  and  industrial,  have  been  used  through  the  course  of  the 
CTAD  program.  The  phantom  testing  covers  a  range  of  CT  system  types  from  relatively  high 
resolution  (>2  Ip/mm)  for  small  object  sizes  (<30  mm  diameter)  to  systems  designed  for  large 
components  (>1  5  m  diameter)  with  resolutions  less  than  1  Ip/mm.  Phaiitoms  have  been  used  on 
each  CT  system  providing  quantitative  measurements  of  the  image  quality  of  scans  obtained.  In 
addition  to  phantoms  for  tiie  simple  measures  of  resolution  and  conti'ast  sensitivity,  phantom  data 
have  been  used  to  calculate  modulation  transfer  function  and  contrast  discrimination  curves. 
Phantoms  for  material/density  measurement  and  other  special  measurements  were  also 
investigated. 


2.0  DISCUSSION 

X-ray  CT  systems  are  imaging  instruments  that  measure  X-ray  linear  attenuation  coefficients  of 
small  volume  elements  of  an  object  It  is  important,  with  an^  instrument  to  have  quantitative 
measures  of  performance. 

2.1  literature  review 

The  initial  developments  of  CT  were  directed  at  medical  diagnostic  applications.  The  medical 
community  has  generated  comprehensive  literature  on  the  theory  and  performance  of  CT  for 
biomedical  applicadons.  The  basic  references  on  the  fundamentals  of  CT  come  from  the  medical 
users  [18-24]. 

Medical  CT  system  performance  measurement  requirements  have  been  described  with  the 
development  of  appropriate  phantoms.  McCullough,  et  al.  [25],  Payne,  et  al.  [26],  and  Bergstrom 
[27]  discuss  measurements  for  performance  evaluation,  acceptance  testing,  and  as  an  ongoing 
quality  assurance  tool  for  CT  scanning  systems.  Tney  discuss  possible  phantom  types  that  can  be 
constracted  to  test  parameters  of  interest.  Goodeaough,  et  al.  [28]  and  White,  et  i.  [29]  describe 
the  developments  of  phantoms  to  be  used  in  measuring  various  parameters.  The  American 
Association  of  Physicists  in  Medicine  (AATM)  also  describe  a  phantom  [30].  Fi^e  2.1-1 
indicates  the  parameters,  generally  agreed  upon  in  the  literature,  that  require  evaluation  in  medical 
CT  systems.  The  ph^mtoms  that  are  used  in  medical  CT  evaluation  have  various  components  that 
test  these  parameter 
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Figure  2.1-1  Parameters  of  iuterest  in  CT  image  quality  measurements. 
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The  theory  of  image  quality  considers  the  modulation  transfer  function  (MTF)  and  the  noise  power 
spectrum  as  the  essential  defming  characteristics  of  imagmg  systems  [31].  These  principles  have 
been  applied  to  medical  CT  ima^ng.  Judy  [32]  describes  using  the  line  spread  fuiiction  and 
Bishchof  and  Ehrbardt  [33]  the  point  spread  function  to  obtain  the  MTF.  Hansen  [34]  describes 
the  noise  power  spectrum  measurement.  Hansen  considers  probability  distributions  to  indicate 
sigrial  detection  probabilities  in  CT  imaging.  Resolution  and  noise  can  be  combined  in  detectability 
limit  curves  which  plot  contrast  needed  to  detect  an  object  versus  the  object  size  for  different  dose 
levels  of  medical  imaging.  These  are  referred  to  as  contrast-detail-dose  (CDD)  curves.  Bergstrom 
[27]  shows  an  example  CDD  curve  from  General  Electric  data  and  discusses  the  difficulties  in 
creating  a  phantom  for  such  measurement.  Cohen  and  Di  Bianca  [35]  use  Ae  ODD  diagram  to 
evaluate  a  CT  scanner. 

As  CT  has  expanded  from  the  medical  to  industrial  applications,  industrial  users  have  discussed  the 
issue  of  sttmdkds.  Dennis  [36]  describes  CT  fundamentals  and  the  image  quality  parameters  from 
an  indns^al  CT  perspective.  The  American  Society  for  Testing  and  Materials  (ASTM)  CT 
St^dardization  Committee,  E7.01.03  has  also  developed  a  document  describing  the  basic 
principles  of  industrial  CT  and  advocate  the  use  of  the  MTF  and  CDD  for  measurement  of  system 
perforrmnee  [37].  For  industrial  applications,  the  CDD  curve  is  referred  to  the  contrast 
discrimination  curve  (CDC).  Sivers  and  Silver  [38]  have  described  the  theoretical  background  and 
experimental  results  of  using  MTF  measurements  and  CDCs  on  industrial  CT  systems.  Jacoby 
and  Lingenfelter  [39]  describe  the  use  of  a  test  phantom  for  monitoring  industrial  CT  system 
performance  over  time. 

2.2  Hiantom  Types 

The  paramet^  listed  in  Figure  2.1-1  may  be  measured  from  data  taken  by  a  phantom  that  contains 
features  which  represent  the  parameter.  A  single  phantom  unit  may  contain  a  variety  of 
subsections  that  wiU  measure  various  parameters.  The  parameters  themselves  are  not  independent, 
but  often  are  (Merent  rnanifesmtions  of  the  fundamentm  performance  characteristics  of  the  system. 
Figure  2.2-1  lists  some  key  categories  for  a  phantom  and  potential  methods  of  obtaining,  the 
measurements. 
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Figrre  2.2- 1  Phantom  categories  ar  d  naeasuieinenl  technique. 
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2.2.1 


Resolution 


Resolution  refers  to  the  ability  to  sense  that  two  features  are  distinct.  Measurements  of  resolution 
by  a  phantom  can  be  performed  in  a  wide  variety  of  ways.  Holes  in  a  uniform  material  of  either 
fixed  diameter  and  changing  separation  or  decreasing  diameter  with  separations  that  also  decrease 
accor^gly  are  very  common.  The  resolution  is  defined  as  the  minimum  separation  detectable.  A 
variation  of  this  design  for  CT  systems  is  a  set  of  square  voids  developed  by  Engle  [40]. 

Plates  of  alternating  high  and  low  density  material  (i.e.,  plastic/air,  metal/air  or  metaVplastic)  can  be 
us?ri  to  mr  ke  line-pair  gauges.  The  resolution  limit  is  determined  by  the  ability  to  see  the  line 
pairs,  lire  loss  in  sensitivity  is  due  to  a  loss  of  modulation  between  the  high  and  low  density 
features  of  the  line  pairs  as  the  plate  thickness  becomes  smaller.  This  can  be  monitored 
numerically  by  a  data  trace  across  the  image  of  the  line  pairs  to  measure  the  modulation  as  a 
function  of  line-pair  si2e.  A  plot  of  the  modulation  values  as  a  function  of  the  line-pair  value  is  the 
Square  wuve  response  of  the  system.  This  is  related  but  not  equivalent  to  the  MTF. 

T^e  MTF  is  defined  for  a  sinusoidal  varying  test  pattern  [31],  however  such  a  pattern  is  very 
difficult  to  construct  for  use  with  X-rays.  Because  of  the  definition  of  the  MTF,  it  can  be 
measured  by  mathematical  calrilation  of  the  Fourier  transform  of  the  one  dimensional  line  spread 
function  (LSF)  or  the  .<vo  dimensional  point  spread  function  (PSF).  The  LSF  and/or  PSF  is 
obtained  by  measurement  of  the  spreading  of  the  image  from  a  delta  function  input  such  as  a  pin  or 
".ire.  If  t!ie  pin  is  small  enough  the  PSF  is  given  directly.  If  not,  the  size  of  the  pin  must  be 
deconvolved  from  the  results.  Because  of  the  problem  of  finding  an  adequate  line  or  point  source 
phantom,  the  LSF  is  very  often  measured  by  differentiation  of  the  edge  spread  function  (ESF). 
The  FSF  is  readily  obtained  from  a  (L,a  trace  acrors  a  sharp  edge  in  the  image. 

The  MTF  ou^ui  is  a  cimre  of  the  response  of  a  system  as  a  function  of  frequency.  It  is  ofkn  useful 
to  have  a  single  numeric  value  to  be  used  for  relative  comparison  of  performance.  In  the  case  of 
the  MTF  an  aroitrary  value  from  the  curve  may  be  taken,  such  as  the  frequency  at  which  the 
moduladon  is  deceased  to  10%.  The  width  of  the  LSF  or  PSF  can  also  be  used  as  a  single 
numeric  value  for  comparison  of  resolution.  Ey  measuring  the  full- width  at  half  maximum 
(FWHM)  of  the  LSF  a  r^tive  value  tha»  is  related  to  the  system  resolution  is  obtained 

Resolution  is  most  commonly  measured  in  the  Ci  image,  which  is  a  slice  through  the  object. 
However,  CT  data  is  fundamentally  volumetric  in  nanue,  multiple  contiguous  CT  slices  result  w  a 
volume  data  base.  Depending  on  rW  use  of  the  data,  it  may  be  mapoitant  to  consider  the  resolution 
in  the  »xial  orientation  of  tire  CT  daft  acquisition.  This  resolution  will  be  for  the  most  part 
deterroined  by  the  effective  slice  thickness  and  axiil  step  spacing,  used  in  th'*'  scanning  sequence 
and  may  be  quite  different  from  the  individual  slice  rcsolurion.  In  addirion,  the  effective  slice 
thicimess  often  will  vary  over  the  field  of  view,  iUuding  to  additioual  resolution  characterirarion 
requirements.  In  the  case  of  direct  volume  CT  imaging  using  cone  beam  geometries,  the  is 
usually  taken  aiid  leconstructed  so  tliat  resolution  L  approximately  the  same  in  all  direcdons  in  the 
volume. 

2.2.2  Contrast  Sensitivity 

Con^st  sensitivity  refen  to  the  grainincss  in  an  image.  The  best  way  to  neasure  contrast 
sensitivity  is  to  obtain  a  histogram  of  pixel  va’ues  in  a  region  of  uniform  density  of  a  test  specimen. 
CfHitrast  sensitivity  is  then  defined  as  the  fractional  standard  deviation  of  the  distribution.  TTie 
inverse  of  this  contrast  sensitivity  value  is  also  commonly  referred  to  as  a  signal-to-noise 
measureoKnt  of  the  system.  The  best  contrast  sensitivity  phantom  is  an  absolutely  featureless 
uniform  disk  composed  of  a  material  whose  X-ray  absoipdon  and  density  mimic  those  of  the  actual 
class  of  imqpecdcn  objetis. 
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In  practice  it  is  of  interest  to  measure  the  contrast  sensitivity  as  a  function  of  the  feature  size. 
Materials  of  vety  close,  but  differing  densities  can  be  used  for  this.  Normally  plugs  of  slightly 
different  densities  are  inserted  into  a  background  material.  The  size  of  the  plugs  is  a  variable. 
Evaluatore  then  determine  which  level  of  contrast  they  can  detect  as  a  function  of  feature  size.  The 
use  of  this  type  of  phantom  can  result  in  a  CDC  By  plotting  the  size  of  feature  with  its  percentage 
contrast  for  detectability,  the  curve  is  generated.  Numerous  samples  however  may  be  required. 
The  contrast  detectability  will  change  with  exposure  and  so  multiple  curves  as  a  function  of  the 
patient  (or  object)  dose  are  created.  The  visual  perception  of  the  detectability  of  features  will  be 
different  for  (Efferent  individuals.  Thus  a  large  number  of  interpreters  should  be  used  to  develop  a 
curve  where,  for  example,  50  percent  of  the  intetytreters  sense  the  contrast  level  for  detection  of 
various  feature  sizes. 

An  alternative  method  to  obtain  the  CDC  is  to  calculate  it  based  on  noise  measurements  as  a 
function  of  region  of  interest  size  in  a  uniform  phantom  and  weight  the  curve  for  loss  of  contrast  as 
a  function  of  resolution  by  using  the  MTF.  The  contrast  requi^  to  detect  a  feature  will  depend 
upon  the  statistical  confidence,  m  terms  of  false  positive  or  false  negatives,  that  one  is  willing  to 
accept.  Figure  2.2-2  shows  the  statistical  variation  in  the  background  and  signal  that  could  be 
observed  in  an  image.  The  contrast  discrimination  (Ap)  necessary  for  detection  depends  on  the 
values  of  acceptable  false  positive  (FP)  and  false  negative  (FN),  respectively,  where  is  the 
standard  deviation  of  the  mean  over  some  specified  feature  size,  p  is  the  FP  and  q  is  the  FN  level  in 
units  of  and  Pj.  is  tlie  critical  value  used  in  the  decision  process  to  decide  if  a  signal  is  present  or 
not  [41].  A  ODC  can  be  created  for  any  combination  of  false  positive  and  false  negative  values  by 
multiplying  the  values  in  the  noise  curve  by  the  sum  of  p  and  q  and  dividing  by  the  MTF 
modi^tioti.  The  (IDC  deteimines  the  nainimum  contrast  that  a  feature  must  have  to  be  detectable  at 
the  statistical  discrimination  levels  selected.  The  exposure  level,  is  a  variable  in  data  acquisition 
which  is  a  facmr  in  the  noise  measurements  as  a  function  of  feature  size. 


Pc 


Figure  2.2-2  Probability  distribution  analysis  fen*  feature  detection. 


2.2.3  Mateiial/Density 

An  important  phantom  function  is  to  establish  the  correlation  between  CIT  value  and  material 
density.  Such  a  phantom  can  be  quite  difficult  to  manufacture  because  it  is  difficult  to  change 
dwsity  .significantly  without  changing  atomic  number.  The  X-ray  attenuation  coefficient  is 
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dependent  on  both  density  and  atomic  number.  At  high  X-ray  energies  where  the  Compton  effect 
dominates  the  attenuation,  die  calibration  is  not  difficult.  At  low  energies,  where  photoelectric 
effects  are  involved  in  the  attenuation,  it  is  a  real  problem.  The  range  of  high  or  low  energy 
depends  on  the  material  being  tested.  At  medical  CT  energies  of  80  keV  effective,  carbon  materials 
can  be  used  for  density  calibration.  At  150  keV  effective  for  a  300  kV  X-ray  system,  even  Mg  and 
A1  may  distort  the  density  calibration. 

The  traditional  density  phantoms  used  in  medical  CT  have  been  liquid  mixtures,  such  as  glycerine 
and  isopropyl  alcohol  or  dilutions  of  potassium  iodide.  These  can  be  used  to  create  steps  of 
density  over  a  very  narrow  range.  Various  polymers,  such  as  acrylic  and  nylon,  have  also  been 
used.  They  have  inherent  manufacturing  variations  which  will  result  in  differing  attenuation 
measurements  between  samples  that  can  be  usefully  employed  to  develop  a  phantom.  Carbon- 
carbon  can  be  manufactured  to  varying  levels  of  densification  in  the  range  of  about  1.3  to  1.8 
g/cto?'  which  makes  a  useful  phantom  for  low  density  calibration.  Densification  of  ceramic 
powders  is  also  feasible  for  ranges  of  about  60  percent  to  full  densification. 

A  phantom  that  consists  of  differing  materials  of  significant  density  variation  for  a  wide  range  of 
industrial  material  applications  may  be  fabricated.  However,  the  evaluation  of  the  results  from 
such  a  phantom  must  consider  the  X-ray  energy  and  the  atomic  elements  involved  when 
extr^iolating  to  other  matmals  not  included  in  the  phantom. 


2.2.4  Other 

Numerous  phantnms  of  all  sizes  and  shapes  have  been  made  to  evaluate  various  characteristics  of  a 
system.  Most  commonly,  pyramids  or  slanting  edges  of  some  type  or  other  have  been  used  to 
assess  the  slice  plane  thickness,  mid  field  uniformity  of  CT  systems.  Phantoms  which  represent 
actual  parts  that  are  defect  free  or  have  anomalies  of  known  dimensions  are  excellent  for 
monitoring  inspection  sensitivity  day-to-day  and  should  be  implemented  if  possible. 

Artifacts  are  features  present  in  the  image  that  are  not  present  in  the  object  All  imaging  systems, 
even  the  human  eye,  will  have  artifacts  at  some  level.  Artifacts  in  CT  systems  range  from  those 
associated  with  the  i^cular  Cr  configuration  such  as  circular  rings  in  3ra  generation  (rotate  only 
Cp  to  those  that  are  CT  process  dependent  such  as  partial  volume  streaks.  Beam  hardening  is  a 
primary  source  of  artifacts  from  TOlychromatic  sources.  Mechanical  inaccuracies,  material 
densities,  and  partial  voluming  effects  can  also  produce  artifacts.  It  is  important  to  be  able  to 
teoogttise  M  artifact  as  such  and  to  understand  the  limitation  the  artifact  places  on  the  recognition  of 
anoa^es  or  measurentent  of  some  critical  characteristic.  Artifacts  must  not  mask  the  presence  of 
anomalies  for  unambiguous  interpretation.  This  is  accomplished  if  the  artifact  noise  level  can  be 
kept  below  the  required  signal  level  for  anomaly  detection.  No  particular  phantoms  are  necessary 
to  monitor  artifacts,  although  pin  phantoms  are  normally  used  for  mechanical  system  alignment. 
The  artifact  pattern  generated  from  the  pin  is  used  to  adjust  the  CT  system  configuration  for 
minimal  artifaedng  [42]. 
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3.0 


TESTING  AND  RESULTS 


A  set  of  CT  phantoms  was  developed  for  the  CTAD  program  in  order  to  provide  consistent 
evaluation  of  results  from  various  CT  systems.  The  phantoms  serve  several  purposes.  First,  they 
provide  a  quantitative  measure  of  the  CT  system  capability  that  can  be  used  repetitively  to  assure 
consistent  performance.  Second,  the  quantitative  measurements  can  be  used  in  conjunction  with 
part  images  to  assess  a  quality  level  necessary  to  achieve  desired  detection  or  measurement  levels  in 
the  insisted  parts.  Tl^,  &e  phantoms  can  be  used  to  select  CT  systems  based  on  the  desired 
sensitivity  level  for  the  CT  application. 

The  use  of  phantoms  for  CT  is  complicated  due  to  the  wide  range  of  parameters  in  any  CT 
inspection.  Therefore,  caution  must  be  used  in  extrapolating  phantom  data  to  suggest  a  "best" 
overall  CT  system.  In  fact,  CT  systems  have  varying  designs  that  result  in  a  range  of  performance 
characteristics.  The  phantoms  allow  the  user  a  quantitative  measure  of  quality  level  that,  combined 
with  other  operating  parameters,  may  suggest  an  optimum  system.  While  resolution  and  contrast 
sensitivity  are  key  performance  measures,  there  are  many  other  additional  parameters  a  user  must 
be  concerned  with  in  selecting  a  CT  system  for  scanning:  scan  time,  field  of  view,  object 
penetration,  object  handling  and  data  manipulation  to  name  a  few. 

Figure  3.0-1  lists  the  different  types  of  CT  systems  used  in  the  CTAD  program.  The  systems  vary 
in  the  jwnetrating  energy,  part  h^dling  capability  and  nominal  scan  time.  The  nominal  scan  time  is 
a  value  typically  used  when  scanning  CTAD  parts  on  the  order  of  the  size  of  the  largest  phantoms. 
For  scanning  much  larger  or  sometimes  smaller  and  lighter  components  the  actual  scan  times  will 
change. 


System 

Energy 

(keV) 

Part  size 

Max.  Dia. 

(m) 

Part 

Weight 

_ m _ 

Nominal 

Scan  Time 
(min) 

A 

420 

0.8 

100 

25 

fi 

420 

0.4 

22 

15 

C 

300 

0,32 

50 

12 

D 

420 

0.075 

23 

1.5 

E 

420 

0.17 

30 

1.5 

H 

2000 

1.6 

1000 

2 

1 

2000 

1.5 

1000 

2 

K 

150 

0.48 

160 

0.07 

L 

420 

1.8 

1000 
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Figure  3.0-1  CT  systems  utilized  in  tlie  CTAD  program. 


Performance  of  any  particular  CT  system  will  change  with  time  due  to  modifications,  alignment 
variations  and  changes  in  operator  techniques.  Thus,  data  presented  in  this  task  assignment  are 
representative  of  performance  at  the  time  and  under  the  conditions  that  the  data  sets  happened  to  be 
obtained.  Changes  in  some  performance  characteristics  by  as  much  100  percent  or  more  are 
certainly  possible  for  some  systems.  However,  as  a  rale  of  thumb,  the  basic  design  configurations 
of  industrial  computed  tomography  (ICT)  systems  appear  to  result  in  performance  measurements 
that  generally  fall  within  50  percent  of  a  nominal  value  for  the  data  acquisition  condition;,  used  in 
routine  object  srj^nning,  and  better  than  10  percent  for  repeat  scans  at  idratical  conditions. 


3.1 


Resolution 


3.1.1  Line-Pair  Phantom 

Figure  3.1-1  is  a  photo^aph  of  a  Ime-pair  resolution  phantom  (PID#  000101).  The  phantom 
consists  of  sets  of  metallic  and  acrylic  plates  of  specified  thickness.  Line  pairs  of  0.5, 1, 2  and  4 
Ip/mm  are  formed  by  Ae  phantom.  The  entire  assembly  is  bolted  togeAer  and  Ae  line-pair  plates 
can  be  changed  if  additional  or  a  different  range  of  line  pairs  is  desired.  Following  CT  scanning 
Ae  reconstracted  inmge  is  analyzed  by  measuring  Ae  modulation  of  Ae  CT  numbers  obtained  firom 
a  trace  across  Ae  line  pairs.  The  modulation  at  each  line  pair  set  is  measured  as  a  percentage, 
where  Ae  mc^ulation  measured  between  Ae  3  mm  (0.12  in)  thick  metal  and  3  mm  (0.12  m)  thick 
acrylic  steps  is  taken  to  be  100  percent  The  resolution  phantom  has  been  fabricated  in  two  forms, 
steel/acrylic  and  aluminum/acrylic.  The  steel/acrylic  phantom  is  for  systems  of  300  kV  and  up,  Ae 
aluminum/aciylic  phantom  is  for  systems  under  300  kV. 

Figure  3.1-2  shows  a  CT  image  of  Ae  steel  resolution  phantom  obtained  fi’om  a  relatively  high- 
resolution  CT  system.  The  CT  image  density  contour  line  across  Ae  phantom  mAcates  modulation 
for  Ae  respective  line-pair  measurements  at  approximately  82  percent  at  1/2  Ip/mm,  46  percent  at  1 
Ip/mm,  4  percent  at  2  Ip/mm,  and  0  percent  at  4  Ip/mm 


Figure  3. 1-1  Photograph  of  Ae  line-pair  phantom 
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CTscan 


Density  trace 


Figuie3.1<2  CT  image  and  CTdensi^  line  tiftce  evaluation  of  the  line-pair  phantom 


Figure  3.1  >3  tabulates  some  nominal  results  for  several  of  the  Figure  3.0-1  CT  systems. 
Measiuement  of  the  modulation  at  the  0.S  Ip/mm  set  was  not  available  for  all  systems  because  that 
particular  line-pair  set  was  not  included  in  some  early  measurements.  Hie  results  indicate  a 
considerable  lan^  in  the  system  c^abilides  but  does  not  necessarily  define  a  cut-off  resolution.  It 
does  provide,  though,  a  useful  discrimination  of  which  systems  have,  for  example,  nominally  1 
Ip/mm  resolution  and  which  are  nominally  2  Ip/mm  and  atove.  The  line-pair  data  have  been  taten 
multiple  times  on  several  systems  and  provide  consistent  measures,  if  the  CT  scan  parameters  are 
kept  constant  Changing  CT  system  parameters  such  as  detector  apertures,  mechanical  alignment, 
reconstruction  algorithm  and  field  of  reconstruction  size  will  alter  the  values  significantly. 
Changing  the  slice  thidkness  or  scan  time  can  have  some  affect  usually  not  significant  depending 
on  the  system. 
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Line-Pair 

Percent  Modulation  at 

Contrast  Sensitivity 

Signal  to  Noise 

mgm 

1 

Ip/mm 

■IBSH 

A 

NA 

55 

1.5 

30 

17 

B 

90 

60 

20 

0.25 

15 

6 

C 

NA 

40 

8 

1.0 

12 

11 

D 

NA 

58 

20 

0.25 

1.5 

25 

E 

91 

57 

7 

0.25 

0.5 

4 

H 

NA 

4 

3.0 

8 

63 

I 

49 

4 

5.0 

5 

52 

K 

63 

7 

1.5 

0.07 

80 

L 

58 

10 

4.0 

1 

I  7 

60 

Rgure  3.1-3  Nominal  results  from  the  line-pair  phantom  and  contrast  sensitivity  measurcmenL 


Rgurc  3.1-4  shows  the  results  of  scanning  both  the  steel  and  the  aluminum  line-pair  phantoms 
simultaneously.  The  result  shows  that  the  modulation  in  the  steel  phantom  is  not  as  high  as  the 
aluminum.  Appendix  A  discusses  how  nonlinear  effects  may  cause  this.  These  data  indicate  that 
line-pair  phantom  measurement  may  net  necessarily  be  consistent  between  phantom  types. 

Care  must  be  taken  in  any  comparative  measurements  tliat  the  same  material  and  physical  design  is 
used  in  the  line-pair  phantom  for  the  various  measurements.  It  is  also  important,  when  using  line- 
pair  grids  to  be  aware  that  aliased  im^cs  may  result.  An  aliased  image  appears  to  show  the  line- 
pair  grids,  however,  the  image  is  artificial,  i.e.,  the  grids  are  beyond  the  resolution  of  the  system 
and  are  not  correctly  imaged,  i.c.,  the  grids  are  reversed  showing  the  metal  as  low  density  and  the 
plastic  or  air  as  high  density.  Because  a  CT  system  uses  sampled  da:a,  frequencies  higher  tlian  the 
system  Nyquist  fiequencics  will  not  be  imaged  properly.  At  some  frequencies  above  the  Nyquist 
frequency,  die  reconstructed  image  will  not  be  a  simple  blurring  of  the  line-pair  data  but  may  invert 
the  data  which  can  be  misinterpreted  as  seeing  line  pairs  tha^  are  not  true  representations  of  the 
object 
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100 


Resolmioa  0«uge  Ckina  painAum) 


Figuic  3.1-4  Line-|)air  measurements  from  system  L  showing  the  difference  in  using  an 
aluminum/aciy  lie  line-pair  set  and  a  steel/acrylic  lis^pair  set  in  the  same  scan. 


3.1.2  MTF 

The  MTF  provides  a  mcMurement  of  the  resolution  of  a  system  by  plotting  the  signal  modulation 
that  Ae  system  can  provide  as  a  function  of  frequency.  The  MTF  characterization  can  be  obtained 
by  different  methods.  One  of  the  easiest  techniques  is  to  calculate  the  MTF  from  line  trace  data 
across  the  edge  of  a  phantom.  In  the  following,  the  edges  used  for  the  measurement  are  from  the 
contrast  sensitivity  <usk  phantom  discussed  in  Section  3.2.  The  process  involves  using  multiple 
traces  across  the  edge  of  the  disk  from  numerous  angles.  This  provides  edge  traces  from  dl 
(orientations  in  the  CT  image.  These  traces  are  averaged  to  form  tiie  ESF,  then  differentiated  to 
form  the  LSF  and  finally  F^iiier  transformed  to  generare  the  MTF. 

Figure  3.1-5  shows  the  LSF  for  each  of  three  different  CT  systems.  Hie  shape  of  the  LSF  is  an 
important  characteristic  of  the  s;jrstcm.  The  full  width  at  half  maximum  (FWHM)  of  the  LSF  is  a 
measure  of  the  relative  resolution  capability  of  each  system.  The  shape  of  the  LSF  should  be 
symmetric.  In  the  Figure  3.1-5  data  System  I  is  symmetric.  System  K  is  slightly  asymmetric  and 
System  D  is  very  asymmetric.  The  asymmetry  may  be  due  to  a  variety  of  causes.  Aliasing  in  the 
data  acquisiticoi,  i.e.,  under  sampling,  truncating  or  clipping  the  ESF,  and  detector  cross  talk  arc  dl 
possible  causes.  Appendix  B  discusses  these  causes  and  their  effects  on  the  LSF. 
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Figure  3. 1-5  line  spread  functions  for  three  CT  systems. 


The  MTF  may  be  calculated  directly  from  the  asymmetric  LSF  or  the  LSF  may  be  processed  to 
form  a  symmetric  function.  Figure  3.1-6  shows  three  possible  MTFs  for  System  D  data.  By 
taking  the  LSF  and  minoring  it  at  the  peak,  symmetric  LSFs  for  the  "air"  and  "aluminum"  halves 
of  the  ESF  are  generated.  Figure  3.1-6  shows  that  MTT  curves  for  each  of  these  three  approaches 
to  handling  the  System  D  data  will  create  significantly  different  curves. 


Figure  3.1-6  MTP  of  System  D  showing  the  effect  of  asymmetric  and  symmetric  LSFs. 


Figures  3.1-7  and  3.1-8  show  the  results  of  MTF  measurements  for  several  CT  systems  using  two 
different  approaches  to  tte  dara  handling-  Two  systems  demonstrate  MTF  values  greater  than  1, 
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which  is  normally  not  to  be  expected,  but  can  occur  due  to  frequency  enhancement  in  the 
reconstruction  algorithms.  In  Figure  3.1-7  the  ESF  data  are  averaged,  low  pass  filtered  and  a 
quadratic  spline  fit  applied  [41].  'Dus  produces  results  which  agree  with  general  perceptions  about 
the  relative  lesolution  capability  of  the  various  systems,  except  for  system  D.  The  System  D  MTF 
predicts  performance  out  to  4  Ip/mm  which  is  beyond  the  resolution  capability  of  System  D  that  has 
been  experienced  as  indicated  by  the  Figure  3.1-3  line-pair  gauge  results.  Figi^  3.1-8  shows  the 
same  phantom  images,  analyzed  by  obtaining  an  average  ESF,  using  a  three  point  running  average 
over  the  curve,  differentiating,  reputing  a  th^  point  running  average  and  then  taking  the  Fourier 
transform.  For  Systems  B  and  D,  tlie  LSF  has  been  modified  to  be  symmetric  by  mirroring  the 
aluminum  side  of  the  ESF. 


Figure  3.1-7  MTF  measurements  for  several  CT  systems. 


Figure  3.1-8  MTF  mcasurctnents  for  several  CT  systems  using  the  aluminum  half  of  the  LSF  for 
asymmetric  LSFs. 
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Figure  3.1-9  tabulates  the  MTF  values  for  5, 10,  and  20  percent  contrast  from  the  two  sets  of  MTF 
calculations  of  Figures  3.1-7  and  3.1-8.  Five  percent  contrast  is  usually  considered  the  limit  of 
resolution  [33].  "fte  FWHM  values  of  the  Figure  3.1-8  LSFs  are  also  listed.  The  MTFs  for  the 
lower  resolution  systems,  A,  H  and  I  are  in  good  agreement  between  the  two  approaches. 
However,  for  the  higher  resolution  systems  (B  and  D)  there  are  significant  differences.  These 
MTFs  demonstrate  (Sstortions  which  may,  in  part,  be  due  to  relatively  greater  noise  in  their  data 
and  how  that  is  handled  by  the  two  techniques.  For  System  D,  Figure  3.1-8  appears  to  be  in  better 
agreement  with  actual  images.  The  use  of  the  material  half  of  the  ESF  for  systems  that  are 
asymmetric  may  make  sense  if  the  feature  detection  for  which  the  system  will  be  used  is  typically 
voids  in  a  base  material.  Smoothing  of  the  data  will  reduce  the  MTF  response,  but  no  smoothing 
has  the  risk  of  inducing  high  frequency  responses  which  are  not  valid.  The  MTFs  of  System  D 
shown  in  Figure  3.1-6  used  no  smoothing  (die  LSF  was  directly  Fourier  transformed).  The  total 
and  aluminum  half  MTFs  can  be  compared  to  the  Figure  3.1-7  and  3.1-8  System  D  curves 
respectively  which  contain  smoothing  of  the  ESFs  and  LSFs.  These  results  show  that  in  practice 
the  MTF  curve  may  be  strongly  dependent  on  the  measurement  methodology  as  the  resolution 
c^ability  and  image  noise  increase. 


Figure  3. 1-9  MTF  frequency  for  5, 10  and  20  peromt  contiasL 


Tlic  MTF  will  be  affected  by  different  parameters  in  a  CT  system  that  affect  resolution.  A  key 
parameter  is  the  reconstniction  algorithm.  Figure  3.1-10  shows  the  effect  of  two  different 
algorithms  (bone  and  soft  tissue)  us^  in  System  K. 
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Figure  3. 1  .0  MTF  measurement  as  a  function  of  the  reconstracdon  aigorithms  for  System  K. 

The  MTF  resolution  measurement  should  not  be  affected  by  the  type  of  material  used  for  the 
phantom,  figure  3.1-1 1  shows  two  MTF  traces  for  System  I  talcen  using  disks  of  aluminum  and 
acrylic.  Tie  difference  in  the  MTF  curves  is  imnimaL 


Figure  3.1-11  MTF  measurement  on  System  I  for  aluminum  and  acrylic  disk  phantoms. 
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Figure  3.1-12  shows  the  MTF  carves  and  the  line-pair  resolution  phantom  values  for  two  CT 
systems  plotted  on  the  same  graph.  The  line-pair  phantom  shows  a  consistently  higher 
modulation.  This  is  not  unexpected  because  the  fine-pair  phantom  is  a  square  wave  response 
which  mathematically  produces  a  hi  ,jher  modulation  than  the  sine  wave  response  of  the  MTF 
Appendix  C  demonstrates  this. 

Care  must  be  talcen  in  how  modulation  from  a  line-pair  grid  is  interpreted.  Stanley  [43]  has  shown 
that  line  pair  grid  images  for  CT  measurements  can  be  aliased,  indicating  at  first  glance,  higher 
resolution  that  is  truly  available.  In  the  aliased  image,  the  materials  are  reversed  in  CT  value  from 
resolved  line  pairs.  When  a  line  pair  gvage  is  us^,  and  it  is  a  very  simple  and  useful  tool,  the 
inteipretation  of  resolution  appies  stricSy  to  objects  that  are  themselves  line  pair  gauges  and  only 
approximates  that  other  features  in  objects  that  are  in  the  same  sii^  range  of  die  smallest  grid  may 
achially  be  resdt'ed. 


Figure  3. 1  -12  Ctaupsaisoa  of  ^  K'flF  curves  with  the  line-pair  phandsa  valtres. 


3.2  Contrast  SensiliidQf 

3,2.1  Disk  Phantom 

Ihe  contrast  sensitivity  phantom  is  a  uniform  disc  of  aluminum,  25  mm  (1  inch)  thick.  Two  sizes 
were  made,  on^  is  1^  mm  (5.5  inch)  in  diameter  000202)  and  die  other  is  70  mm  (2.76 
inch)  in  ^mnerer  (PlD#  000301).  Ths  smaller  diameter  size  Is  us«i  on  systems  with  small  fields 
of  view,  or  low  kV.  Figure  3.2-1  shows  an  example  CT  slice  of  the  lai'ge  aluminma  cmitrasi 
sensitivity  phantmn  with  the  co£respcHidm|  density 


Figure  32- 1  CT  sli(»  of  the^ntrast  sensitivity  phantom. 


/ :  The  mcaismement  of  contrast  sensitivity  is  obtained  by  taking  a  region  in  the  center  of  the 
,  leconstracted  image  determining  the  average  and  standard  deviation  for  all  CT  numbers  in  the 
region.  A  typical  region  aze  of  1  cm  (0.39  inch)  diameter  is  used.  Readings  are  usually  taken  at 
the  t^ter  Qf  thZ’  disk.  The  rado  of  tlis  averags  to  the  standard  deviation  is  used  as  a  signal  to  noise 
measuretE^t.  Ite  inv«*se  is  a  measure  of  contrast  sensitivity.  The  si^  to  noise  measurement 
fordie  iuMge  shbivn  in  Figure  3.2-1  is  approximately  6. 

The  tegt^-lo-npise  ratio  is  an  iai^rtant  measure  of  system  performance.  The  values  improve  with 
hi^-er  signal  streng^^. .  Large  slice  thickness  and  longer  scan  times  will  also  improve  signal  to 
ntti^.  Hgtire  3,1-3  included  tire  values  of  signal  to  noise  fc^  the  CT  systems  used  in  the  linc-paii‘ 
phsttttmi  m?^men»n®  Tor  the  sUce  thickness  and  scan  time  indicated.  Figure  3.2-2  shows  tiie 
unpj'ovemcht  of:5ignal.to  noise  for  Sy?^^m  K  as  a  function  of  scan  time.  Signal  to  noise  will  also 
ini^rove  with  S3teOoUting  algorithms  in  the  reconstruction;  however^  this  will  decrease  the 
resolutioHr  Thus*  the  3igi^-to-,aoise  and  resolution  must  ‘oe  consitod  together  in  assessing  level 
,  of  Quality. 


Figure  3J2-2  Signal  to  noise  aa  a  function  of  scan  times  for  System  K  for  3  slice  thicknesses. 


3.2.2  Contrast  Discrimination  Curves 

A  method  of  combining  signal  to  noise  and  resolution  is  the  use  of  the  contrast  discrimination 
curve  (CDC).  The  ccmtrast  disoimination  is  affected  by  the  feature  size.  Low  contrast  chMges  are 
easier  to  detect  over  larger  areas,  than  in  small  areas  where  they  are  easily  masked  by  noise.  This 
effect  can  be  calibrated^  measuring  the  statistical  variations  in  the  values  of  the  means  of  the  CT 
numbers  as  a  hmction  of  the  size  of  the  region  of  interest  Figure  3.2-3  plots  the  error  in  the  mean 
of  the  CT  value  (standard  deviation  of  the  means,  3m)  for  a  number  of  readings,  as  a  function  of 
the  feature  size  (size  of  the  region  o£  interest)  on  sev^  CT  systems. 


Figure  3J2-3  Error  in  the  mm  as  a  function  of  feature  size  fm*  several  CT  systems. 
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From  this  curve  and  the  M1F>  it  is  possible  to  generate  the  CDC  as  discussed  in  Section  2.2.2- 
The  conversion  of  MTF  line-pair  values  to  the  feature  size  is  obtained  by  multiplying  the  line- 
pair/mm  by  two  and  inverting  to  provide  modulation  as  a  function  of  feature  size. 

Figure  3.2-4  shows  the  CDC  for  five  CT  systems.  The  CDCs  are  plotted  for  10  percent  false 
positive  and  false  negative  discrimination  levels.  The  lower  the  contrast  discrimination  value  on 
the  curve,  the  easier  it  should  be  to  detect  features.  Thus,  systems  such  as  H  and  K  would  be  most 
likely  to  detect  low  contrast  changes  in  an  object.  It  is  interesting  that  System  K,  which  is  a 
medical  scanner,  has  excellent  contrast  discrimination.  Medical  systems  can  play  a  useful  role  in 
industrial  CT  for  components  that  can  be  penetrated  with  the  lower  kV  and  that  fit  within  the 
medical  gantry  system  size.  The  CDC  data  are  scan-time  dependent.  Thus  scanning  longer  or  with 
larger  slice  thickness  should  drive  the  curves  lower.  The  systems  shown  in  this  figure,  of  course, 
have  been  operated  at  different  scan  times,  sUce  thicknesses  and  X-ray  energiesAntensities  that  are 
appropriate  for  the  goal  of  that  particular  CT  system  design. 


Figure  3.2-4  CDC  for  several  CT  systems  at  10  and  percent  false  positive  and  false  negative 
values. 


Figure  3.2-5  shows  how  the  effect  of  the  selection  of  the  false  positive  and  false  negative 
discrimination  levels  on  tire  CDC.  Figure  3.2-6  shows  how  the  CDC  is  affected  when  a  different 
material  is  used  as  the  disk  phantom.  In  this  case  an  acrylic  disk  is  compared  to  an  aluminum  disk 
at  the  10  percent  false  positive,  false  negative  values.  The  curves  cross  over  each  other,  requiring 
lower  contrast  for  detection  in  aciylic  than  aluminum  at  very  small  feature  size  and  higher  contrast 
at  large  feature  size.  For  large  feature  sizes,  the  apparent  increase  in  conn-ast  requirement  for 
detection  in  acrylic  may  be  due  to  the  inherent  variation  of  polymer  materials  over  large  areas, 
which  would  tend  to  add  noise  as  the  features  size  becomes  large.  In  this  plot,  a  contrast 
discrimination  of  greater  than  100  perant  is  allowed.  This  could  occur  for  the  case  of  a  high 
density  inclusion  in  a  lower  density  background. 
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Feature  Size  (mm) 


Figure  Z2-6  Coufxast  discrimination  curves  for  two  phantom  materials  at  10  percent  false  positive 
and  false  negative  values  on  System  L 


3.3  Material/Density  Phantom 

A  material  calibration  phantom  (PID#  000201)  was  constructed  according  to  the  plan  shown  in 
Fi^re  3.3-1.  It  consists  of  an  acrylic  disk  of  140  mm  (5.5  inch)  diameter  with  inserts  of  10 
various  materials.  The  inserts  are  machined  to  specific  tolerances  and  weighed  to  obtain  the 
density.  The  accuracy  of  the  density  value  is  estimated  to  be  better  than  one  percent  The  aciylic 
disk  is  SO  mm  thick,  but  the  inserts  are  only  25  mm  long,  which  leaves  a  uniform  a^lic  disk  area 
in  the  phantom  which  can  be  used  for  other  measurements,  such  as  the  MTF  describe  in  Section 
3.1J2  tuidin  Figure  3.1-11  and  the  CDD  of  Section  3J2.2  and  Figure  3.2-5. 

A  CT  scan  of  the  material  calibration  phantom  is  shown  in  Figure  3.3-2.  The  CT  numbers  for  each 
insert  from  the  reconstmcicd  image  are  plotted  against  the  measured  densities  to  serve  as  a 
edibration  curve  for  the  system.  The  insert  materials  vary  in  atomic  number  which  adds  another 
variable  in  the  process  when  the  X-ray  energy  is  such  that  the  photoelectric  effects  are  significant 
[44].  The  phantom  is  useful  for  generating  a  general  density  calihratkm  curve  a  CT  system. 
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Each  density  i^antom  is  a  cylinder  measuring 

13  mm  (.05  In)  dia.  x  25  mm  (1 .0  in)  ♦/■  .0025  mm  (.001  in) 

The  oyUrKiers  and  their  corresponding  densities  are  listed  betow. 


Material  Densly  IqIcd) 


1 

Air  Gap 

0.945 

2 

High  Molecular  We^ht  Polyethylene 

1.156 

3 

Nylon 

1.165 

4 

Nylatron 

1.193 

S 

A^ic  Plexiglas  (coremateriai) 

1.507 

6 

OeWn 

1.784 

7 

Magnesium 

2.179 

a 

Teftnn 

2.704 

9 

Aluminum 

4.423 

10 

Titanium 

Hgttre  3.3-1  Cbnstnicdon  plan  for  a  material  calibration  phantom  (PID#(XX)201). 
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Fipre  3.3-2  CT  imago  of  the  matedal  calibration  phantom. 


The  calibration  plots  for  several  CT  systems  are  shown  in  Figure  3.3-3.  The  CT  number  is 
averaged  over  a  smaU  region  in  the  center  of  each  insert  and  is  plotted  along  the  horizontal  axis 
with  material  density  plotted  along  the  vertical.  A  linear  regression  line  has  been  drawn  through 
die  points  on  each  graph.  Figure  3.3-4  tabulates  the  standard  error  of  the  regression  lines  as  a 
function  of  the  CT  system  ana  X-ray  energy  used.  At  very  high  energies  the  CT  data  plots  are 
nearly  straight  indicating  that  the  CT  values  are  linearly  related  to  density,  independent  of  the 
atomic  elements  present.  This  is  expected  for  Compton  attenuation.  At  low  ener^  the  CT  values 
are  strongly  affected  by  the  various  atomic  elennnts  present.  This  effect  is  described  by  Kropas, 
Moran  and  Yancey  [44]  who  used  dual-energy  techniques  to  isolate  the  effect  of  the  magnesium 
additive  in  the  Nylatron  on  the  calibration  curve  as  a  function  of  energy.  The  inclusion  in  the 
phantom  of  materials  which  contain  different  ammic  elements  can  be  used  effectively  to  detect 
variations  in  the  effective  X-ray  beam  energy. 
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Figuit3.3>3  CaUbiatkm  plots  for  sevo^CT  systems 


CT  ^stem 

Energy 

(kV) 

Standard  Error 
of  Regression  Line 

K 

120 

0.288 

C 

300 

0.178 

B 

420 

0.128 

I 

2000 

0.078 

Figure  3.3-4  Standard  deviation  of  the  regression  line  for  several  CT  systems. 


The  PE)#  000201  phantom  included  a  titanium  alloy  insert  with  a  density  of  4.4  ^cm^.  For  low 
energy  systems,  this  large  a  range  of  density  in  the  phantom  causes  significant  artifacts  and  poor 
calibration  for  the  lighter  elements  that  would  normdly  be  inspected.  A  second  material  phantom 
(PE)#  000203)  has  been  fabricated  that  is  nearly  identical  to  the  Fi^e  3.3-5  phantom  with 
exception  of  the  replacement  of  the  titanium  with  a  second  alloy  of  aluminum.  The  two  aluminum 
alloys  are  6061  and  2024.  Figure  3.3  -5  lists  the  handbook  vdues  of  percent  alloy  content.  The 
2024  alloy  contains  4.4  percent  copper  while  the  6061  contains  only  0.25  percent  copper  and  is 
about  2  percent  lower  density.  Figure  3.3-6  shows  a  plot  of  CT  value  from  System  L  for  this 
phantom.  The  difference  between  the  6061  and  2024  is  readily  detected. 


Alloy 

Percent  of  Alloying  Elements 

Cu  Si  Mg  Ni 

Other 

2024 

4.4 

0.5 

1.5 

6061 

0.25 

0.6 

1.0 

0.25  Cr 

Hgure  3.3-5  Constituents  of 2024  and  6061  aluminum  alloys. 


CTV«1ub 


Figure  33-6  Plot  of  CT  values  for  the  PID#  000203  materkl  phantom. 
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Because  this  phantom  design  contains  sets  of  pins,  scans  of  the  phantom  will  readily  detect  classic 
central  ray  a^acting  if  scanner  misalignment  exists.  Thus,  the  phantom  can  serve  multiple 
purposes  as  a  monitoring  tool  of  material  calibration,  alignment,  resolution  and  contrast 
disoimination. 


3.4  Dimensional  Me^urement 

Extraction  of  positional  and  dimensional  information  from  complex  assemblies  represents  an 
important  application  of  X-ray  computed  tomography.  Example  applications  include  noninvasively 
measuring  gaps  between  stators  and  rotors  in  sealed  safe  and  arm  devices  and  measuring 
deformations  of  advanced  composite  materials  under  mechanical  load  at  rocket  nozzle  operating 
temperatures.  It  is  also  used  where  no  mechanical  or  optical  photogrammetry  method  is  possible  to 
produce  accurate,  dimensioned  representations  of  assemblies. 

A  basic  assumption  made  in  these  calculations  is  the  absolute  equivalence  of  the  CT  image  frame  of 
reference  and  the  scanned  object  frame  of  reference.  Because  this  equivalence  depends  on  a  variety 
of  factors  including  mechanical,  motion,  physical  element,  analysis  methods,  software 
implementation,  and  calibration  methods,  it  is  possible  tiiat  significant  eirors  are  introduced  making 
this  assumption.  An  effort  was  therefore  undertaken  to  assess  the  degree  of  dimensional  fidelity 
between  a  scanned  part  and  its  CT  image  using  three  CT  systems  (A,  H  and  L).  These 
experiments  directly  measured  the  local  transformation  matrix  between  a  part  and  its  CT  images 
produced  by  scanning  a  high  precision  phantom,  in  a  variety  of  orientations. 

3.4.1  Dimensional  Measurement  Phantom 

An  aluminum  test  phantom  was  machined  using  a  precision,  numerically  controlled  mill  operated 
so  as  to  minimize  backlash  errors.  This  "dimensional  measurement  phantom"  (DMP)  consisted  of 
a  16.5  mm  (0.65  inch)  thick  disk,  200  mm  (7.87  inch)  in  diameter  with  forty-nine  8.6  mm  (0.34 
inch)  diameter  precision  drilled  holes  forming  a  rectangular  matrix  at  equal  spacings  of  20  mm 
(0.787  inch)  plus  or  minus  0.006  mm  (0.00025  inch).  Three  additional,  precisely  located,  small 
holes  were  drilled  adjacent  to  two  comers  of  the  large  hole  matrix,  two  at  one  comer  and  one  at  the 
adjacent  comer  to  serve  as  reference  points  during  image  analysis.  Figure  3.4-1  shows  a  CT  scan 
of  the  DMP  in  the  nominal  orientation  used  for  the  measurements  discussed  below. 


Figure  3.4-1  CT  image  of  the  dimensional  measurement  phantom  obtained  from  system  L  in 
nominal  position  showing  precision  hole  pattern  and  fiducial  marks. 
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3.4.2 


Metric 


The  dimensional  phantom  provides  a  metric  for  the  precise  dimensional  analysis  of  scanned  parts. 
Figure  3.4-2  shows  the  concept  of  the  metric  r  which  measures  distortion.  The  metric  uses  the 
local  Jacobian  of  the  transformation  matrix  between  the  part  and  its  CT  image  representation  to 
provide  a  quantitative  means  of  assessing  the  inherent  geometric  accuracy  of  any  given  CT  system. 
The  details  of  the  metric  and  results  are  &cussed  in  Appendix  D. 
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r  is  the  "dimensional  distortion" 


Figure  3.4-2  Dimensional  phantom  metric  concept. 


Example  T  map  for  a 
particular  test 


Figure  3.4-3  summarizes  the  outcome  of  phantom  measurements  for  three  CT  systems.  The  fkst 
column  identifies  the  system.  The  second  shows  the  mean  value  of  the  dimensional  distortion 
metric  (Ty)  measured  for  each  of  the  systems.  This  is  an  index  of  the  overall  level  of  image 
distortion  and  shows  that  it  was  extremely  small.  The  third  column  gives  the  ratio  of  the  6a  width 
of  the  deduced  distribution  of  principal  diagonal  measurements  ratioed  to  the  nominal  dimension. 
It  is  a  measure  of  system  precision.  The  last  column  indicates  system  accuracy.  It  is  the  offset  of 
the  peak  of  die  probability  distribution  for  the  diagonal  iengtli  from  the  nominal  value.  It  probably 
overstates  the  Inaccuracy  for  system  L  which  had  a  "forced  offset"  owing  to  probable  slight 
misalignment  and  the  calibration  method  employed.  The  accuracy  determined  for  the  other  two 
systems  falls  well  within  the  uncertainty  in  part  dimension  that  would  be  associated  with  noimal 
temperature  variations  in  the  working  enviromnent  (±10°F)  for  a  coefficient  of  Uiermal  expansion 
of  aluminum  of  12.2  x  10*^. 
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Figure  3.4-3  Summary  of  dimensional  fidelity  measurements  metric  on  the  DMP. 


The  methodology  adopted  in  this  study  should  be  easily  transportable  to  other  systems  for  which 
an  inherent  geometry  accuracy  (IGA)  is  desired.  Location  of  the  centers  of  an  array  of  precision 
machined  holes  in  the  CT  image  of  a  test  article  for  comparison  with  the  lotmtion  of  the  holes  in  the 
part  itself  is  an  excellent  means  of  deriving  the  elements  of  the  local  transformation  matrix  for  IGA 
determination.  The  success  of  the  method  relies  on  the  fact  that  the  hole  center  location  is 
insensitive  to  the  criterion  used  for  finding  the  hole  edge,  particulajly  because  the  hole  center 
coordinates  are  highly  over-determined.  Methods  that  rely  on  precise  determination  of  edges  (e.g. 
finding  the  absolute  chameter  of  the  test  article)  will  be  less  successful  because  they  are  sensitive  to 
the  definition  of  an  edge  in  the  image. 

3.5  Special  Measurement 

A  special  phantom  for  measuring  CTT  slice  characteristics  is  shown  in  Figure  3.4-1.  The  basic 
design  consists  of  a  tube  with  a  spiral  slit  in  the  wall.  The  tube  may  be  any  suitable  material. 
Aluminum  (PID#  000806)  and  acrylic  (PID#  000807)  have  been  used.  Tne  slit  size  and  shape  may 
be  varied  depending  on  the  CT  system  resolution.  When  the  phantom  is  imaged,  the  slice  width 
will  be  given  by  the  circumferential  length  of  the  slit  in  the  image.  The  radial  location  will 
determine  the  vertical  height  of  the  sUce.  By  mounting  multiple  units  in  a  scan  field  a  measurement 
of  the  slice  uniformity  can  be  obtained.  Fi^e  3.5-1  shows  an  example  of  a  set  of  these  phantoms 
used  in  testing  a  field  of  reconstruction.  The  array  of  the  slit  phantoms  assess  the  uniformity  of  a 
slice  plane  for  a  large  field  ctf  view  CT  system. 


*  ti:i  any  bt  Itta  (iuta  wiU 

Figure  3.5- 1  Spiral  slit  phantom  design. 
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Figure  3,S>2  CT  image  of  a  set  of  19  mm  diameter  spiral  slit  phantoms  for  testing  a  field  of 
lecoQstructioiL 
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4.0 


CONCLUSIONS 


‘Hie  CTAD  program  efforts  on  standards  has  resulted  in  the  application  of  several  phantom  types  to 
the  measurement  of  CT  system  operational  parameters.  The  relative  performance  analysis  of 
several  different  types  of  CT  systems  have  been  calculated. 

The  simple  line-pair  resolution  phantom  is  easy  to  use.  However,  the  line-pair  phantom  results 
should  not  be  consideied  completely  accurate  measures  of  resolution  except  in  so  far  as  they  are 
used  self  consistently  for  repeat  studies.  Variations  in  the  manufacture  of  a  line-pair  phantom  can 
be  expected  to  produce  a  difference  in  the  results.  The  modulation  transfer  function  (MTF)  method 
of  assessing  resolution  provides  insight  into  the  characteristics  of  the  CT  system  from  the  shape  of 
the  curve.  Cut-off  frequencies  can  be  taken  from  tlie  MIT  curve  to  be  used  as  simple  performance 
indicators.  The  mathematical  approach  used  in  the  calculation  of  the  MTF  w;  il  affect  the  results, 
particularly  as  the  resolution  of  the  system  increases.  The  affect  of  asymmetric  lines  spread 
functions  must  be  taken  into  consideration  as  well. 

Contrast  sensitivity  is  measured  with  a  uniform  material  phantom.  The  relatively  simple  signal-to- 
noise  measurement,  based  on  the  division  of  the  mean  by  the  standard  deviation  in  a  region  of 
interest  in  the  phantom,  is  an  important  measure  of  performance.  Contrast-detail-dose  (CDD) 
curves  can  be  calculated  using  measurements  of  the  standard  deviation  of  the  mean  values  as  a 
function  of  feature  size  and  the  MTF,  all  of  which  can  be  obtained  from  data  taken  on  the  uniform 
disk  phantom.  The  CDD  provides  a  useful  description  of  the  performance  characteristics  of  a  CT 
system.  However,  the  curves  do  need  to  be  validated  against  the  detectobility  of  known  features  in 
industiial  objects.  The  selection  of  the  false  positive  and  false  negative  values  used  in  the  CDD 
curve  calculation  remains  a  subjective  issue  which  needs  to  be  better  defined  with  respect  to  the 
routine  inspection  of  industrial  objects. 

The  material  phantom,  described  in  Section  3.3,  can  be  usefuUy  employed  as  a  relative  calibration 
standard.  For  any  specific  industrial  application  area,  the  plugs  should  be  altered  to  represent  the 
materials  typically  encountered  in  CT  examinations.  The  background  material  could  also  be 
altered.  The  calibration  can  be  used  as  a  periodic  system  performance  monitor  and  tlie  lower  half 
of  the  phantom  can  be  used  for  MTF  and  CDD  calculations. 

Tue  dimensional  measurement  phantom  metric  provides  a  useful,  quantitative  assessment  of  the 
inherent  geometric  accuracy  of  a  CT  scanner.  TTie  methodology  for  this  measurement  obtains  the 
accurate  positional  measurement  from  the  use  of  a  hole  to  locate  the  hole  center  in  tlie  CT  image. 
The  technique  can  map  a  field  response  of  the  scanner  distortion.  Such  information  is  important 
for  determining  the  limit  of  measurement  accuracy. 

The  application  of  phantoms  as  performance  monitors  under  the  CTAD  program  demonstrates  the 
differences  that  exist  in  the  industrial  systems  available.  The  phantoms  do  not  however  necessaiily 
indicate  a  specific  superiority  of  any  one  system  over  anotlier  because,  factors  such  as  part  size  aiid 
scan  time  are  also  significant  variables  between  systems.  The  phantoms  are  indicators  of  the 
expected  performance  on  object  materials  and  sizes  related  to  those  of  the  pha:itoms.  For  the  CT 
examination  of  components,  a  phantom  containing  critical  measurement  features  that  match  as 
closely  as  possible  tue  object  is  recommended. 
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APPENDIX  A  .  NON  LINEAR  EFFECT  ON  LINE  PAIR  GAUGE  * 


I 


The  modulation  in  a  line  pair  gauge  appears  to  depend  on  the  composition  of  the  phantom  based  on 
the  figure  3.1-4  data.  This  may  be  due  to  beam  hardening  nonlinearity.  Simulations  were  run 
using  nonlinear  projection  software  for  line  integrals  and  then  images  were  reconstructed  from  the 
projections.  For  the  line  pair  phantom,  the  object  was  composed  of  rectangular  cross  section 
objects  with  width  and  spacing  chosen  to  give  die  line  pair  image.  Four  sets  of  reconstructions 
were  run.  Two  sets  were  linear  with  high  and  low  attenuation.  The  actual  values  were  the  linear 
attenuation  coefficients  of  aluminum  and  steel  at  150  keV  (0.372  cm'^  and  1.54  cm’l  respectively). 
The  remaining  two  sets  computed  the  projections  using  a  nonlinear  attenuation.  A  program 
extracted  the  data  from  a  specified  line  in  the  image  and  dumped  them  to  a  disk  file. 

Line  out  data  of  the  bar  phantom  with  zero  nonlinearity  are  shown  in  figure  A-1.  Figure  A- la 
shows  the  low  attenuation  while  figure  A- lb  shows  the  high  attenuation  data.  The  modulation 
(MTF)  c^culated  from  these  data  are  shown  in  figure  A-lc.  The  MTF  modulation  was  calculated 
as  the  ratio  of  ^plitudes  at  the  firequency  to  the  low  frequency  values.  No  corrections  were  made 
for  the  harmonics  of  the  square  wave.  Figure  A-2  shows  the  line  out  data  with  a  nonlinear  system. 
Figures  A-2a  and  A-2b  are  the  line  outs  with  low  and  high  attenuation  data  respectively  and  the 
modulation  computed  from  these  data  is  shown  in  figure  A-2c.  With  a  nonlinear  system,  the 
results  depend  on  the  attenuation  of  the  phantom  and  conform  to  figure  3.1-4  with  steel  giving 
lower  modulation  values  than  aluminum. 
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Figure  A-1  Line  out  data  with  linear  system.  Two  phantoms  with  attenuation  simulating  aluminum 
(part  a)  and  steel  (part  b)  were  used.  Part  c  shows  the  MTF  calculated  from  these  data.  As 
expect^  the  results  do  not  depend  on  the  composition. 


*  From  "Final  Monthly  Progress  Report,  Advanced  Development  of  X-Ray  Computed 
Tennography  Applications,"  ARACOR,  Analysis  by  Robert  Alvarez,  June  1993. 
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Figure  A-2  line  out  data  with  a  nonlinear  system.  Two  phantoms  with  attenuation  simulating 
aluminum  (part  a)  and  steel  (part  b)  were  used.  Pf ’t  c  shows  the  MTF  calculated 
from  these  data.  Now  the  results  do  depend  on  thu  composition. 
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APPENDIX  B  -  CAUSES  OF  ASYMMETRIC  LSF  * 


B.  1  Aliasing  effects  on  the  LSF 

A  CT  scanner  is  a  sampled  data  system  because  it  measures  the  projections  with  a  finite  number  of 
detectors  and  with  a  f^te  number  of  angular  positions  of  the  gantry.  Any  sampled  data  system 
will  have  artifacts  when  trying  to  process  real  data  which  can  have  a  bandwidth  greater  than  the 
system’s  Nyquist  frequency  (which  is  equal  to  one  half  the  sampling  frequency).  These  artifacts, 
called  aliasing  artifacts,  can  have  a  significant  effect  on  the  measured 

CT  scanners  produce  two  dimensional  images  and  therefoni  require  sampling  in  two  dimensions. 
The  sampling  is  determined  by  the  spacing  between  detecto.rs  and  the  number  of  projection  angles. 
On  a  two  dimensional  plane  the  sammples  are  on  radiai  lines  through  the  origin  separated  by 
constant  angles  when  p^allel  beam  geometry  is  used. 

The  LSF  for  the  reconstruction  of  a  disk  using  256  detectors  and  128  projection  angles  is  shown  in 
figure  A-1.  Notice  that  is  asymmetrical  and  resembles  the  curve  for  system  K  in  Figure  3.1-5. 
The  LSF  with  increased  number  of  angles  but  the  same  number  of  detectors  is  almost  identical  to 
the  curve  so  is  not  shown.  Apparently  aliasing  due  to  sampling  in  the  angle  direction  does  not 
cause  the  asymmetry  measured  (at  least  for  this  objtxt  whicli  is  centered  so  its  projections  are  the 
same  at  all  angles). 


Figure  B.  1  - 1  LSF  ctunputed  from  the  reconstructed  image  of  disk  using  256  detectors  and  1 28 
projection  angles.  Notice  tlat  it  is  asymmetrical 


*  From  "Final  Monthly  Progress  Report,  Advanced  Development  of  X-Ray  Computed 
Tomogiaphy  Applications,"  ARACXDR,  Analysis  by  Robert  Alvarez,  June  1993. 
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The  LSF  for  the  reconstructed  image  with  1024  detectors  and  128  angles  is  shown  in  figure  A-2. 
Notice  that  this  result  is  essentially  symmetrical  and  appears  to  be  a  sinc( )  function  as  would  be 
expected  because  the  filtering  function  used  in  the  reconstruction  algorithm  was  flat  over  the 
passband.  Apparently  increasing  the  number  of  detectors  reduces  the  asymmetry  of  the  measured 
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Figure  B.  1  -2  LSF  from  the  reconstracted  image  of  disk  using  1 024  detectors  and  128  projection 
angles.  Notice  that  it  is  symmetrical. 


Figures  B.1-1  and  B.1-2  show  that  the  asymmetry  may  be  due  to  aliasing  but  there  are  many  other 
factors  that  may  complicate  the  results.  To  focus  in  on  aliasing  due  to  sampling  with  a  finite 
number  of  detectors,  simulations  were  run  with  continuous  sampling  (that  is  an  infinite  number  of 
detectore  spaced  infinitesimally  close  togetlier)  and  with  a  finite  sampling  frequency.  The  object 
was  a  circular  disk  centered  at  the  origin.  With  this  simple  object,  the  two  mmensional  Fourier 
transform  could  be  computed  analytically.  To  compute  the  reconstructed  image  with  "detector 
aliasing,"  the  Central  Section  Theorem  was  used  to  give  the  one  dimensional  spectrum  of  each 
projection.  Aliasing  was  introduced  by  adding  in  copies  of  this  spectrum  offset  by  a  specified 
sampling  frequency.  Applying  the  Central  Section  Theorem  again,  tliis  gives  the  two  dimensional 
spectrum  on  radial  lines  through  the  origin.  This  can  be  inverse  transformed  to  give  the 
reconstructed  image  with  aliasing  only  due  to  a  finite  number  of  detectors. 

Images  with  the  profiles  wiA  and  without  aliasing  were  created  and  then  analyzed.  The  LSF  with 
no  aliasing  in  figure  B.1-3  is  symmetrical  as  expected.  The  LSF  computed  from  the  image  with 
aliasing  is  shown  in  figure  B.1-4.  It  is  asymmetrical  and  is  similar'  to  the  curves  from  the 
reconstructed  images. 
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FiguieB.1-3  LSF  computed  from  image  with  no  aliasing. 


riguie  B.  1-4  LSF  computed  from  image  with  aliasing. 
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B.2 


Clipping  Effect  on  LSF 


Discontinuities  always  cause  problems  for  a  finite  bandwidth  system  such  as  a  CT  scanner.  In 
particular,  a  reconstructed  image  of  an  edge  can  contain  overshoot  or  undershoot  artifacts  which 
can  make  it  difficult  to  image  Stalls  close  to  the  edge.  This  artifact  is  especially  troublesome  in 
medical  CT  systems  where  undershoot  on  the  inner  surface  of  the  skull  can  mask  injuries  to  the 
surface  of  the  brain.  Some  CT  systems  may  clip  the  values  (that  is  set  them  to  the  surrounding 
values)  to  try  to  avoid  the  undershoot  artifact.  TTus  nonlinear  processing  can  clearly  have  a  strong 
effect  on  MTF  calculation. 

The  results  of  the  computer  simulations  of  clipping  are  displayed  in  figure  B.2-1.  This  shows 
three  sets  of  functions  calculated  from  the  images.  The  first  row  -  Parts  (a)  and  (b)  -  are  the  edge 
response  functions.  The  region  outside  the  cylinder  -  the  "air  values"  -  is  plotted  to  the  left  on  the 
graphs.  The  edge  response  clearly  shows  the  clipping  in  this  region  -  note  that  the  clipped  data  do 
not  dip  below  zero.  The  second  row  -  parts  (c)  and  (d)  -  are  the  line  response  functions.  Notice 
tliat  the  data  for  the  clipped  image  are  asymmetrical  and  are  similar  to  some  of  the  experimental 
functions  in  figure  3.1-5. 
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Figure  B.2-1  Effect  of  clipping  on  the  calculation  of  the  MTF.  The  first  column  shows  the  results 
with  no  clipping  while  the  second  column  shows  the  results  with  clipping.  Parts  (a)  and  (b)  show 
the  edge  responses.  Parts  (c)  and  (d)  show  tlie  line  responses. 
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B.3 


Cross  Talk  Effect  on  LSF 


Interdetector  cross  talk  in  CT  scanners  using  "translate/rotate"  detectors  can  cause  artifacts  that 
affect  MTF_ measurements.  With  these  "translate/rotate"  detectors,  especially  those  used  with  high 
energy  radiadon,  relatively  large  collimators  are  used  so  there  is  a  large  space  between  the 
scintillating  crystals  of  the  detectors.  The  full  set  of  measurements  are  made  by  translating  the 
detector  array  to  acquire  the  data  for  the  positions  between  the  active  areas  of  the  detectors.  If,  at  a 
given  position,  one  of  the  detectors  encounters  a  large  change  in  radiation  flux,  then  the  change  in 
scatter^  radiation  wiU  affect  the  measurements  of  the  adjacent  detectors.  The  scatter  will  affect  the 
measurements  in  a  characteristic  pattern  whose  period  is  the  distance  between  the  detectors. 

A  siinulation  of  cross  talk  effects  was  run  by  adding  simulated  scatter  to  detector  measurements. 
The  line  integrals  of  a  cylinder  with  and  without  cross  talk  were  used  to  compute  images.  The 
results  of  edge  analysis  of  the  simulated  image  are  shown  in  ngurs  B.3-1.  The  cross  talk  changes 
Ae  reconstmcted  values  at  tlie  outer  edge  of  the.  cylinder.  This  is  e'^ddem  in  the  edge  response  data 
in  part  (b)  of  the  figure.  Ihis  leads  to  the  asymmetrical  line  spread  function  data  in  part  (d). 
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esf^wHh  crosstalk 

(b) 


-2 


X 


X 


Figure  B.3-1  Effect  of  interdetector  cross  talk  on  MTF  calculations.  The  left  column  shows  the 
results  with  no  cross  talk  while  the  right  column  has  cross  talk.  Parts  (a)  and  (b)  show  the  edge 
responses.  Parts  (c)  and  (d)  show  the  line  responses. 
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APPENDIX  C  .  SQUARE  WAVE  RESPONSE  AND  MODULATION  TRANSFER 

FUNCTIONS* 


An  alternative  method  for  computing  the  MTF  is  to  use  an  image  of  a  "line  pair"  phantom.  Since 
the  plates  in  the  phantom  have  uniform  densities,  this  method  actually  measures  the  square  wave 
response  (SWR).  The  MTF  is  defined  in  terms  of  the  response  to  an  object  whose  value  changes 
sinusoidally,  so  the  two  functions  are  not  the  same. 

Suppose  you  could  make  an  object  whose  value  varies  sinusoidally  as  shown  in  part  (a)  of  figure 
C-1.  Assume  a  one  dimensional  case.  The  two  dimensional  results  are  the  same  so  long  as  the 
object  is  much  longer  in  the  other  dimension  than  the  period  of  the  waves.)  The  two  columns  in 
figure  C-1  show  the  spatial  and  transform  domain  views  of  the  imaging  piocess.  The  spatial 
domain  view  (left  column)  is  tliat  the  object  (a)  is  convolved  with  the  system  impulse  response  (c) 
resulting  in  the  reconstructed  image  (e).  The  transform  domain  view  is  that  the  transform  of  the 
object  (b)  is  multiplied  by  the  transfer  function  (which  is  the  transform  of  the  impulse  response)  to 
give  the  transform  of  the  reconstructed  image. 

The  MTF  at  the  spatial  frequency  of  the  object  can  be  computed  from  the  amplitude  A  of  the 
reconstructed  image  in  part  (e).  Assume  the  object  is  c(x)  with  a  Fourier  transform  C(f).  The 
system  impulse  response  is  h(x)  and  its  Fourier  transform  is  the  transfer  function  H(f).  Therefore 
the  reconstructed  image  Cr(x)  and  its  transform  are: 


cj<x)  =  c(x)*h(x) 

(1) 

Cr(f)  =  C(f)H(f) 

(2) 

By  a  fundamental  property  of  the  Fourier  transform,  the  value  of  a  function  at  zero  is  equal  to  the 
integral  of  the  Fourier  transform  over  all  frequencies.  Thus,  the  amplitude  A  which  is  equal  to  the 
value  of  the  reconstructed  image  at  zero  is: 

oo  oo 

A=Cy(0)==  JCr(f)df=  Jc(f)H(f)df 

-oo  -oo  (3) 


when  the  object  is  a  sinusoid  with  period  L  c(x)  =  cos(2nb(/L)  and  its  Fourier  transform  is: 


C(f)=K8(f-r)  +  8(f+i;)) 


The  Fourier  transform  is  two  delta  functions  at  frequency  ±  as  shown  in  figure  C-  i 
Substituting  in  equation  (3),  the  amplitude  is: 

A=5(H(f-x)+H(f+r))  (5) 

If  the  impulse  response  is  symmetric,  tlien  the  amplitude  is  equal  to  tlie  transfer  functirn  at  die 
fiequency  of  the  sinusoid. 

*  From  "Final  Monthly  Progress  Report,  Advanced  Development  of  X-Ray  Computed 
Tomography  Applications,"  ARACOR,  analysis  by  Robert  Alvaiez,  June  1993. 
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Now,  suppose  the  object  c(x)  is  a  square  wave  of  period  L  as  shown  in  figure  C-2a.  This  may  be 
represent^  as  a  rectangle  function  conceived  with  a  train  of  delta  functions: 


c(x)=2n(2x/L)*  X5(x-nL)-l 

U  9—00 


(6) 


where  n(x)=l  for  Ixk  ~  and  0  otherwise.  The  Fourier  transform  C(f)  can  be  calculated  by  using 
the  convolution  theorem  and  the  following  Fourier  transforms: 


F[n(2x/U]  =  ^sinc(u/2) 


X  -nL) 


(7a) 

(7b) 


F[lj=:5(£) 

Using  these  with  equation  (6) 


C(f)=  Z®^c(|-)8(x-|) 


(7c) 


(8) 


The  an^litude  A  is  just  the  integral  of  the  product  of  this  function  and  H(f)  as  in  equation  (4). 


It  1^0 


(9) 


Notice  the  similarity  U)  equation  (5).  Instead  of  just  two  tenns,  there  are  now  an  infinite  number  of 
terms  corresponding  to  the  harmonics  of  the  fundamental  &equeucy  required  to  represent  the 
square  wave. 

The  higher  order  terms  in  equation  (9)  decrease  in  magnitude  rapidly,  of  course,  but  they  are  not 
negligible  so  the  square  wave  response  is  not  the  same  as  the  MTF.  A  numerical  example  is 
useful.  Suppose  the  impulse  response  is  a  rectangle  of  width  L/2,  h(x)=p(2x/L),  its  Fourier 
transform  is  given  by  equation  (7a).  In  equation  (10),  the  sine  function  is  zero  unless  n  is  odd  and 


sine  ( '^2"*)  ~  ^  ^  ^ 

a=¥-?-VI-^ 

Vny  i:“-«<2k+i)  (ji) 
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Using  Mathematica,  the  first  100  terms  of  the  sum  are 


49 

fly  2  - — 

U/fc=-50(2k+  1) 


2 


0.995947 


(12) 


Thus  A=172  for  a  square  wave.  For  a  sinusoid,  A=H(1/L)=.^  sinc(l/2)=L/JC.  The  values  are 
not  the  same. 
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Figure  C-1  Spatial  auid  Fourier  transform  views  of  measuring  the  transfer  function  using  a 
sinusoidally  varv'ing  object.  The  spatial  view  is  in  the  left  hand  colunw,  the  Fourier  uansfonn 
view  is  in  the  light  £uid  column. 
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Figure  C-2  Relationship  between  the  square  wave  response  and  the  transfer  function.  The 
reconstructed  image  of  a  square  wave  depends  on  the  values  of  the  transfer  function  at  the 
frequency  of  the  square  wave  and  its  harmonics  (multiples  of  the  frequency). 
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APPENDIX  D  -  DIMENSIONAL  MEASUREMENT  PHANTOM 

CALCULATUIONS 


D.l  Analytical  Approach 

Evaluation  of  the  mapping  fidelity  of  CT  scanners  requires  development  of  an  appropriate  metric. 
The  following  discussion  presents  an  approach  comr:aonly  used  in  continuum  mechanics  to 
evaluate  deformation  in  objects  undergoing  some  form  of  mechanical  transformation  (e.g.  a  test 
article  undergoing  stress  testing).  Since  formation  of  a  CT  image  can  be  thought  of  as  a 
mechanical  transformation  from  the  object  space  to  a  (hopefully)  equivalent  image  space,  the 
formalism  appeared  ^propriate  in  this  application;  an  assumption  Aat  was  justified  by  the  results. 
The  coordinates  (X,Y)  in  the  image  frame  of  reference  of  a  "point"  (e.g.,  a  small  hole  in  a  scanned 
plate)  can  be  expressed  as  a  function  of  the  points  actual  coordinate  (x,y)  with  respect  to  the  plate 
itself. 


X=X  (x.y) 

Y=y(x,y) 

In  classical  continuum  mechanics  terminology,  the  image  coordinate  corresponds  to  the  Lagran^an 
description  of  the  part  configuration  where  the  actual  coordinate  corresponds  to  the  Eulerian 
desOTption.  If  the  functions  are  continuous  one-to-one  mappings  with  continuous  partial 
derivatives,  one  can  define  the  local  transformation  matrix 


M(x,y)  = 


ax 

dx 

SI 

dx 

dy 

If,  for  exanrple,  die  image  and  actual  frame  of  reference  are  equivalent,  (e.g.,  X=x4-xo  and 
Y^y+yo),  then 


M(x,y)« 


1  0 
0  1 


Similarly,  if  there  is  a  relative  rotation  through  an  angle,  a,  such  as  would  be  caused  by  simple 
niispositioning  of  the  part  or  turntable,  or  a  simple  sofiwaio  error  in  tlie  rotational  transfonnation: 


X  =  X  cos  a  ♦  y  sin  a  +  Xo 
Y  a  X  sin  a  +  y  cos  a  +  y© 
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then 


> 


t 


« 


M(x.y)  = 


cosa  -smcx 
sin  a  cos  a 


In  either  case,  the  Jacobmn  (the  determinant  of  M(x,y))  is  equal  to  one: 
,,  ,  /axaY  dYdX\  , 


This  represents  a  transformation  of  zero  deformation.  If  deformation  is  present,  the  local  Jacobian 
will  differ  from  unity  and  the  magnitude  of  the  difference  becomes  a  metric  for  the  distortion.  The 
"degree  of  equivalence"  of  the  image  and  actual  coordinates,  in  other  words  the  CT  system’s 
"inherent  geometric  accuracy"  GG A)  at  position  (x,y)  can  thus  be  defined  as 


r 

In  practice,  measurement  of  GGA)  at  every  point  on  a  CT  scan  image  is  not  feasible.  However,  an 
estimate  of  the  IGA  of  a  CT  system  can  be  made  at  selected  locations  and  die  results  can  be  used  to 
assess  the  global  image  fidelity  (assuming  deformations  are  reasonably  small).  This  was  applied  to 
the  data  collected  on  die  DMP.  The  analytical  method  relied  on  a  comparison  of  the  location  of  the 
centers  of  the  drilled  holes,  taken  four  at  a  time,  in  the  object  and  image  planes  after  appropriate 
processing  of  the  CT  images  to  remove  axial  scaling  factors  present  in  the  screen  images  of  the 
scanner  di^lay.  These  processes  were  carried  out  using  scaling  elements  included  in  the  CT  scan 
field. 

Hole  centers  were  used  because  locating  the  edges  of  a  tiny  hole  accurately  is  subject  to  large  errors 
caused  by  the  difficulty  in  defining  the  hole  edge  in  the  image.  Hole  centers  can  be  precisely 
located,  if  the  appropriate  analytical  method  is  employed.  This  is  because  of  the  large  number  of 
edge  elements  whicn  can  be  used  to  calculate  the  holes'  centers.  The  contour  representing  the 
hole's  edge  may  be  inaccurate,  but  the  center  of  the  contour  is  at  the  center  of  the  hole,  indeperdent 
of  the  edge  fin^g  method  used. 

The  hole  center  coordinates,  (X(j,Yij),  form  the  elements  of  two  7*by-7  matrices  in  X  and  Y.  In 
this  notation,  the  top  left  hand  hole  center,  in  image  coordinates,  is  Xu  Yu  lying  adjacent  to  the 
single  fiducial  hole  shown  in  fipre  3.4,1.  Tlie  transformation  matrix  can  be  estinmted  for  each  set 
of  four  adjacent  holes  as  follows.  First  assume  that  locally  the  transformation  matrix  is  smooth, 
that  is,  it  doesn’t  vaiy  discontinuously  with  position.  If  that  is  so,  wc  can  use  bilinear  interpolation 
to  approximate  X(x,y)  and  Y(x,y)  within  the  rectangle  bounded  by  the  four  holes  as: 

X(x,y)  =:  ao  +  aix  +  a2y  +  asxy 

Y(x,y)  =  bo  +  bix  +  bay  +  bsxy 

Since  we  know  the  values  at  the  comer  points  we  can  set  up  equations  to  solve  for  ao,  ai,  aa,  a3  as 
shown. 
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Xij 

X(i+l)(j+l) 

Xji  yij 

xCi+i)j  y(i+i)j 

Im) 

^(i+l)0+l)  ^Ci+DO'+l) 


(Xij  yij) 

(X(i+l)jy(i+l)j) 

JJi(j+l)yi(j+l)) 

^^(i+i)(j+i)y(i+i)(j+i))J 


ao 

ai 

^2 

as 


Similarly,  bo,bi,b2,  and  bs  can  be  solved  for.  The  partial  derivatives,  necessary  for  calculation  of 
the  local  Jacobian  are  then  estimated  at  the  center  of  each  four  hole  array,  (x,  y). 

^  =  a*  +  a  -Ic 
dy  ^  ^ 

=  b,  *  bjy 

*=  b «  +  b  -T 

Oy  2  S 

where  the  asterisk  (*)  denotes  an  approximate  estimate  of  the  partial  derivative.  The  above  leads  to 
an  array  of  36  Jacobians  associated  with  each  of  the  unique  4-hole  combinations  in  the  49  hole 
array: 


FinaHy,  tfie  local  values  of  die  deformation  parmaeter,  r,  is  calculat  :d. 


These  values  were  used  in  a  variety  of  ways  to  quantify  image  dimensional  fidelity.  Globally 
speaking,  r  values  were  on  the  ort^  of  10*^  for  all  data  from  the  three  CT  scanners  evaluated,  as 
mustraied  ih  figure  3.4.2-1. 

D,2  Example  Results 


A  useful  index  of  performance  was  found  to  be  the  quantity: 


r  *  -  i  J  J  i: 

ictl  J=il  *J 


* 


which  provides  an  absolute  measure  of  the  inherent  geometric  capability  of  the  CT  system.  Figure 
D2-1  shows  the  results  of  taking  die  data  from  the  three  scanners,  calcukiing  r*  for  each  image 
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obtained  with  the  DMP  in  a  "nominal"  configuration,  establishing  the  mean  and  standard  deviation, 
and  fitting  the  results  to  a  Gaussian  distribution.  The  "nominal"  configuration  is  illustrated  in 
figime  3.4-1.  Data  obtained  in  additional  orientations  and  with  tilt  are  not  included  in  these  results 
but  will  be  discussed  in  later  paragraphs.  The  very  narrow  distribution  for  system  H  results, 
primarily,  from  a  very  linuted  data  set  (4  points).  The  width  of  the  curves  for  systems  A  and  L 
reflects  the  relative  precision  of  dimensional  measurements  discussed  below.  It  is  important  to 
note  that  all  the  scaimers  produced  very  little  image  distortion  as  be  more  apparent  from  the 
representative  dimensional  data. 


Figure  D.2- 1  Gamma  probability  distribution  for  nominal  case  obtained  fron  3  CT  systems. 


Additional  insights  are  provided  by  producing  a  grayscale  map  of  ry*  over  the  image  plane  as 
shown  for  the  collection  of  data  from  system  L  in  figure  D.2-2.  If  present,  this  type  of 
representation  can  reveal  local  "astigmatism"  and  "near  or  farsightedness."  In  the  cases  illustrated 
here,  no  systematic  pattern  of  image  distortion  was  identified  Similarly,  the  radial  geometric 
accuracy  can  be  estimated,  by  calculating  circumferendjd  averages  of  intcrpolants  of  ry  at  constant 
«  radius. 
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Figure  D,2-2  Contour  map  of  rn  over  hole  pattern  of  DMP  from  system  L.  Measurement 
corditions  are  given  by  file  number  In  Figure  D^4. 


Tlte  significance  of  the  data  is  clarified  by  evaluating  representative  image  dimensional  data. 
The  analysis  comi^'ed  the  physical  and  image  locations  of  each  hole  center  and  established  iliat,  on 
average,  hole  centers  were  located  to  witliin  less  than  0.025  mm  (0.001  inch).  Tins  is  most  easily 
appreciated  by  examining  the  length  of  the  principal  diagonal  (from  (i,j)  =  (1,1)  to  (7,7)) 
determined  from  the  CT  data  and  comparing  it  to  the  same  dimension  on  tlie  DMP.  Figure  D.2-3 
shows  the  result  of  laldng  the  nominal  data  sets  from  each  system,  calculating  the  principal 
olQgoii^  length»  establishing  the  nic&n  und  standard  doviadoiii  and  expressing  tlie  results  witli  a 
Gaussian  fit.  Systems  A  and  L  used  6  data  sets  while  system  H  used  4.  Hie  design  lengtli  of  the 
principal  diagonal  is  indicated  on  the  figure.  This  was  checked  by  measurements  with  a  calipers 
accurate  to  ±  a  few  mils.  The  range  of  possible  diagonal  lengths  associated  with  a  ±  10®F 
temperature  range  (which  is  easily  produced  during  scanning  and  certainly  encountered  from  one 
facility-to-the-next)  is  also  shown.  These  data,  for  system  H.  indicate  both  high  accuracy 
(closeness  of  the  most  probable  measured  value  to  actual)  and  high  precision  (magnitude  of  the 
potential  inaccuracy  at  the  6o  point  for  example).  It  should  be  borne  in  mind,  however,  that  the 
data  set  for  system  H  was  very  limited.  System  A  had  high  accuracy  with  reduced  precision. 
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System  L  produced  the  least  accuracy  but  had  similar  precision  to  system  H  to  which  it  is  identical. 
Again,  note  that  all  systems  produced  most  probable  values  within  0.050  mm  (0.002  inches)  of 
nominal,  and  that  temperamre  differences  of  only  lO^F  can  account  for  half  of  the  inaccuracy. 
When  all  data  for  systems  A  and  L  was  included,  the  conclusions  illustrated  by  figure  D.2-3  were 
not  substantially  altered.  This  expanded  data  set  included  cases  where  an  edge  of  the  DMP  was 
shimmed  to  pro^ce  rhomboids  in  the  CT  slice  plane. 


Ad  for  AT  =  ±10F 


Diagonal  Dimension  Between  Corner  Holes  on 
DMP  (inches) 


Figure  D.2-3  Distribution  of  calculated  length  of  DMP  principal  diagonal  for  three  CT  systems. 


While  figure  D.2-3  suggests  that  tliere  are  well  defined  differences  in  accuracy  between  the  three 
1  systems,  it  is  important  to  appreciate  that,  witli  the  very  small  errors  in  diagonal  deduced  here, 

calibration  of  the  data  analysis  process  is  the  largest  potential  source  of  error.  Initial  analysis  was 
based  on  measurement  of  the  distance  between  the  center  of  the  single  and  paired  fiducial  holes  in 
A  die  DMP.  Specifically,  the  distance  from  the  single  hole  center  to  ilie  midpoint  between  the  centers 

of  the  two  holes  was  established  and  used  to  calibrate  the  same  distance  in  the  CT  images.  The 
initial  value  used  for  the  fiducial  resulted  in  a  disagreement  between  calculated  and  measured 
diagonals  of  about  0. 10  ram  (0.004  inches).  When  the  fiducial  length  was  rcchecked  for  this 
report,  a  new  estimate  of  its  length  resulted  which  was  approximately  O.lO  mm  (0.004  inches) 
smaller  than  the  original.  Use  of  the  revised  value  shifted  the  distribution  curves  into  near 
agreement  with  the  nominal  value  shown  on  figure  D.2-3.  Because  of  the  sensitivity  of  the  result 
to  the  accuracy  of  the  measurement  of  fiducial  length  (which  is  difficult  to  obtain  wiili  hand-held 
measuring  devices),  the  data  of  figure  D.2-3  were  recalibrated  by  multiplying  the  calculated  mcjuis 
of  the  second  diagonals  by  the  factor  required  to  set  them  equal  to  the  nominal  value  (6.68  inches) 
measured  for  this  length.  The  calibration  factor  developed  in  this  way  was  then  ured  to  calibrate 
the  measurement  of  die  principal  diagonal.  Use  of  the  second  diagonal  lengtli  for  calibration. 
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instead  of  the  DMP  diameter,  for  example,  was  chosen  because  the  diagonal  distance  between  hole 
centers  was  calculated  in  the  same  way  for  all  holes.  Calibration  of  the  hole  separations  relative  to 
the  calculated,  and  measured  diameter  of  the  DMP  requires  location  of  the  hole  centers  from 
threshold  data  to  be  compared  with  the  diameter  which  can  not  be  defined  (from  threshold  data) 
with  equal  precision.  The  diagonal  length  was  chosen  for  calibration  because  it  is  sufficiently  large 
to  be  measured  with  hand-held  instrumerits  with  adequate  precision. 

As  will  be  seen  from  data  presented  in  following  paragraphs,  system  L  was  known  to  have  slightly 

defective  alignment  at  the  time  of  these  tests.  This  was  apparent  in  a  dependence  of  the  calculated 

diagonal  lengths  on  part  rotational  orientation  with  the  average  difference  between  calculated 

principal  and  second  diagonals  being  approximately  0.050  mm  (0.002  inches).  Since  this  known 

error  was  not  corrected  out  in  data  reduction,  requiring  that  the  calculated  second  diagonal  length 

be  equal  to  the  nominal  measured  value,  forced  the  calculated  principal  diagonal  to  differ  from  ^ 

nominal  by  the  0.050  mm  (0.002  inch)  offset  shown  in  figure  D.2-3.  Systems  A  and  H  also  had 

minor,  systematic  disagreement  between  calculated  diagonals  that  had  some  sensitivity  to  rotational 

alignment,  but  the  offsets  were  generally  less  than  0.025  mm  (0.001  inch).  With  these  * 

considerations  in  mind,  it  is  appropriate  to  conclude  that  all  systems  produced  equivalent  accuracy 

within  about  0.025  mm  (0.001)  inch  of  nominal  on  a  170  mm  (6.7  inch)  length.  The  conclusions 

with  respect  to  precision  are,  however,  unaffected  by  calibration  errors. 

The  measurements  discussed  above  define  the  basic  fidelity  of  CT  images  with  respect  to  the  part 
from  wliich  they  are  generated.  They  gathered  a  statistical  base  on  deformation  and  dimensional 
precision  and  accmcy  when  the  part  was  repeatedly  scanned  in  one  orientation  on  three  different 
CT  systems.  Additi  onal  measurements  were  made  to  explore  the  "robustness"  of  CT  image  fidelity 
with  respect  to  the  orientation  of  the  the  scanned  part  and  scanner  parametrics.  These  additional 
experiments  were  duplicated  on  systems  A  and  L  (only  nominal  cases  were  done  on  system  H). 

Figure  D.2-4  summarisces  tlie  results  for  neasurement  of  the  principal  and  second  diagonal  lengtli 
in  the  image.  The  ordinate  calibration  was  established  to  approximately  align  the  second  diagonal 
measurements  (in  the  nominal  case)  with  the  nominal  second  diagonal  ^niension  of  the  part. 

However,  variations  between  measurements  were  not  normalized  out.  The  variations  in  part  and 
scanner  parameters  are  given  in  the  key.  Part  orientations  included  nominal,  10  and  20  degree 
rotations,  overturning  (fiducials  s.xciianged  horizontally  in  figure  3.4.1)  and  tilting  by  shimming 
(0.12,  0.25  and  0.5  ram  on  system  A;  1,  1.6  and  3.2  mm  on  system  L).  System  parametrics 
included  nominal  and  increased  slice  thicknesses,  nominal  and  increased  FOV,  and  standard  slices 
above  and  below  the  nominal  plane.  In  addition,  scans  on  system  A  involved  both  360  and  180 
scarts  (tlie  latter  case  contains  "180"  in  tite  data  file  name).  Variations  on  system  H  involved  420 

keV  and  2  MeV  X-ray  energies  <;which  resulted  in  very  small,  systenratic  differences  in  r  and  the 
diagonal  lengths). 

T 

The  figure  shows  the  systematic  difference  between  diagonal  measurements  on  system  L 

mentioned  above.  Notice  that  rotation  iluough  20  degrees  (231401)  causes  convergence  of  tlie  two 

diagonal  measurements  and  that  turning  the  part  over  (which  interchanges  the  diagonals)  results  in  i 

a  reversal  of  ^e  relative  values  of  tlie  calculated  diagonal  lengths  (231601).  It  is  likely  that  careful 

alignment,  using  tlie  DMP  as  a  diagnostic  can  eliminate  tlie  illustrated  orientational  sensitivity  of  the 

system.  Similar  sensitivity  appears  to  be  observed  with  system  A  but  the  relative  error  is  very 

small  and  the  effect  tends  to  be  obscured  by  the  somewhat  lower  precision  of  this  machine.  The 

figure  shows  that  repeatability  is  very  high  wiili  system  L  (and  fjossibiy  with  H  altliough  the  data 

are  too  sparso  to  draw  fum  conclusions).  The  poorer  repeatability  of  system  A  is  again  related  to 

lower  precision.  Overall,  it  is  clear  that  the  fideiiiy  of  the  CT  image,  produced  on  a  well  aligned 

system  (at  least  of  the  types  used  in  this  study),  is  very  high  and  generally  insensitive  to  the 

orientation  variations  to  be  expected  in  normal  setups. 
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Figure  D.2*4  Principal  and  second  diagonal  lengtlis  of  the  DMP  calculated  from  CT  images  of 
tl^  scanners  obtained  under  vaiious  experimental  conditions. 
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CT  Image  in  Test  Sequence 


